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Abstract — We propose the application of multiple-bases belief- 
propagation, an optimized iterative decoding method, to a set 
of rate-1/2 LDPC codes from the IEEE 802.16e WiMAX stan- 
dard. The presented approach allows for improved decoding 
performance when signaling over the AWGN channel. As all 
required operations for this method can be run in parallel, the 
decoding delay of this method and standard belief-propagation 
decoding are equal. The obtained results are compared to the 
performance of LDPC codes optimized with the progressive edge- 
growth algorithm and to bounds from information theory. It will 
be shown that the discussed method mitigates the gap to the 
well-known random coding bound by about 20 percent. 

I. Introduction 

The use of belief-propagation (BP) decoding [1] with re- 
dundant parity-check matrix representations has drawn a lot 
of attention. Several authors [2], [3], [4], [5], [6] presented 
pioneering work on the binary erasure channel (BEC) and 
provided results on the number of redundant parity-check 
equations required to prevent certain decoder failures. The 
concepts used on the BEC cannot be transferred to the additive 
white Gaussian noise (AWGN) channel in a straightforward 
manner For this reason, several authors designed algorithms 
to use redundant code descriptions for BP decoding of data sig- 
naled over the AWGN channel. A proof of concept using the 
extended Golay code of length 24 was already given in [7]. In 
[8] and [9], adaptive BP algorithms were proposed. These al- 
gorithms adjust the parity-check information for each iteration, 
taking into account the current decoder state. They require 
additional operations which cannot be parallelized and hence 
increase the delay of the data stream. The random redundant 
decoding (RRD) algorithm [10] uses multiple parity-check 
matrix representations in a serial fashion to decode block 
codes in an iterative manner and achieves good performance 
improvements. After a given number of iterations it stores the 
current decoding state, changes the parity-check matrix and 
resumes decoding. For this reason it has to conduct many 
iterations and thus imposes a high decoding delay. A recent 
paper by the authors of the RRD algorithm [11] shows that 
the field of application of this algorithm is obviously restricted 
to algebraic codes. We proposed the multiple-bases belief- 
propagation (MBBP) [12] algorithm, which uses redundant 
parity information in a completely parallel setting and reported 
good results with algebraic codes [12], as well as LDPC codes 
optimized by the progressive edge-growth (PEG) algorithm 
[13], [14]. In [13] we introduced the Leaking algorithm, which 



is a modified BP decoding algorithm. It was shown that the 
combination of MBBP and the Leaking algorithm is a valuable 
tool to improve the decoding performance if a low number 
of redundant parity checks is available. In this paper, we 
extend the field of application of MBBP to iteratively decoded 
channel codes from the Worldwide Interoperability for Mi- 
crowave Access (WiMAX) standard [15] and demonstrate the 
effectiveness of the algorithm for this class of codes. Also, we 
compare the performance of these codes to the performance 
of optimized PEG codes of comparable length, both for BP 
and MBBP decoding. 

The paper is structured as follows. In Section II we describe 
the transmission setup and review the basic principles of 
MBBP decoding. Section III states how a set of different 
parity-check matrix representations is generated, and Sec- 
tion IV presents a selection of results including the comparison 
to PEG codes with equal rate and similar length. 

II. Transmission setup and channel coding 

In this section we introduce a consistent notation and give 
a proper definition of the channel setup. A source emits non- 
redundant binary information symbols u, which are encoded 
and mapped to binary antipodal symbols x. As systematic en- 
coding leads to several advantages [16], this type of encoding 
is used throughout this work. Due to the fact that exclusively 
[n, k, d] block codes are used in this investigation, the encoded 
symbols are denoted as vectors x of length n. These vectors 
are transmitted over the AWGN channel. In this context, y 
denotes the noisy received vector corresponding to x. At the 
receiver, an iterative decoding scheme is used to estimate x 
and the corresponding source symbols. This scheme is either 
a standard BP decoder or the MBBP decoding setup. Let us 
briefly review the basic properties of MBBP, which allows 
for the performance improvements discussed in this paper 
MBBP is an iterative decoding scheme, originally designed 
to decode block codes with dense parity-check matrices [17]. 
To this end, it runs multiple instances of the BP decoding 
algorithm in parallel. Each of these decoders is provided with 
the received signal y and a different parity-check matrix for 
the code. In this context, we denote the / parity-check matrix 
representations by Hi to Hi. The corresponding codeword 
estimates are xi to xi and the candidate forwarded to the 
information sink is x. 

This algorithm is motivated by the fact that different parity- 
check matrices allow for decoding of different error patterns 
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Fig. 1. MBBP decoding setup 

when the suboptimal BP decoding algorithm is used. This 
can be understood as "decoder diversity". It is the task of 
the post-processing unit to combine these capabiHties such 
that one single decoder estimate can be forwarded to the 
information sink. This is a degree of freedom in the MBBP 
design. Moreover, the opportunity of allowing the decoders to 
communicate with each other exists. A multitude of variations 
of this type have been introduced in [17]. In this work, 
we focus on non-communicating parallel BP decoders and a 
post-processing unit that deploys the usual Euclidean distance 
metric. It uses this metric to select the codeword which is 
closest to the received vector y from the decoder outputs 
(MBBP-NX-S setup in [17]). Figure 1 visualizes this approach. 

We will also make use of the Leaking algorithm to improve 
the decoding performance of WiMAX LDPC codes. This 
method keeps channel information from the decoder and 
allows it only to "leak" into the decoding progress with rising 
iteration number. It was shown that this method mitigates the 
problems of BP decoding with short cycles. In order to use 
this approach, two variables need to set: pc, the probability of 
a variable node being informed on the channel output in the 
first iteration as well as the parameter /^lax' 'he (hypothetical) 
iteration number for which all channel information is included 
in the decoding process. Detailed information on this algorithm 
can be found in [13]. We refer to an MBBP setup using the 
Leaking algorithm by L-MBBP. 

The WiMAX standard provides a multitude of channel 
codes. A performance comparison for signaling over the 
AWGN channel, confirming that the class of LDPC codes 
is among the most powerful codes in this setup, can be 
found in [18]. Inspired by its short length and a discussion 
on the practical relevance of these codes [19], the rate-1/2 
LDPC codes proposed in the IEEE 802. 16e standard [15] are 
investigated in this work. As we are generally interested in 
codes of short length, we restrict our attention to codes of 
length 576 < n < 960. For comparison we also consider 
PEG-optimized codes of rate 1/2 and length 500 <n< 1000. 

III. Parity-check matrix representations 

We review a general method to construct redundant parity- 
checks from a given matrix and present a novel method for 
LDPC codes from the WiMAX standard. A comparison shows 
the advantage of the second approach. 



A. Set of matrix representations for MBBP decoding 

The most crucial parameter for the success of MBBP 
decoding is the set of parity-check matrices used in the 
decoding instances. Especially simulations with PEG codes 
[13] have shown that the applied matrices need to fulfill two 
criteria. First, the Tanner graphs [20] of the matrices need 
to differ sufficiently in their structure such that the decoders 
obtain a decoding diversity and a performance improvement. 
Second, the decoders running on the parity-check matrices 
need to obtain comparable performance results. Adding a 
representation to an existing MBBP setup can only increase 
the overall performance if its standard BP performance is 
comparable to the performance of the current MBBP setup. 

In [13] a general method to construct a set of redundant 
parity-check matrices for a given code was presented. This 
method was originally intended to provide good redundant 
parity-check matrices for PEG-constructed codes of short 
length and makes use of the fact that there exist cycles of 
length 4 and 6 in the Tanner graph. Especially for code lengths 
n < 1000, many additional parity-check equations can be 
found with this method. The aim of this approach, to be 
described in detail shortly, is to approximate the property "low- 
density" for the additional checks. Let c be the length of the 
considered cycle and let Qc be one set of indices of parity 
checks closing a cycle of length c. A linear combination of 
the parity checks indexed by the set Qc leads to a novel parity- 
check equation with a (Hamming) weight of at most 
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(1) 



where Wi denotes the weight of parity check i. This is a 
general approach and can be used for any parity-check matrix 
with a local cycle length of c. It was shown in [13] and [14] 
that this approach leads to desirable performance results when 
using PEG codes. However, the parity-check matrix of the 
WiMAX codes show more structure, what allows for a better 
construction algorithm. 

B. Parity-check matrices for codes specified in the IEEE 
802. 16e standard 

The LDPC codes of rate 1/2 standardized in [15] are 
all deducted from one base matrix H'^. The realizations of 
different lengths are created from this matrix by lifting [20]. 
Prior to this step, a renormalization is done, i.e. the lifting 
procedure is applied to the elements 
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of the matrix H]^. 

In this context, z is the expansion factor and depends on 
the code realization. The lifting procedure, from which the 
parity-check matrix H results, is described as follows. Each 
negative entry in the base matrix H]^ is replaced by a z x z zero 
matrix and each non-negative element H\^{i,j) is substituted 
by an identity matrix which is cyclically shifted to the right 
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by i?b(i, j) positions. Equation (3) specifies the base matrix 
i?b for the rate-1/2 LDPC code [15, p. 628]. 

Performing the Hfting approach leads to the binary matrix 
H. Considering that any entry in is replaced by a 
permutation matrix with constant row weight one, it is easy to 
see from Equation (3) that the weight of any parity check of 
i? is 6 or 7, regardless of the actual length n of the code. The 
girth of the code was found to be 6 for all lengths considered. 
It is now our task to determine parity checks which are linear 
combinations of the given parity checks and have as low as 
possible weight. 

C. Redundant parity checks from Hy, 

The novel approach for creating redundant parity-check 
equations uses the base matrix instead of the binary 
matrix H to find valid linear combinations. Subsequently it 
performs the lifting operation on the redundant checks. Let us 
elaborate on the generation of these checks. In a binary matrix, 
a redundant check can be found as a linear combination of 
two or more existing checks. This proceeding is in general 
not possible when the base matrix ff b is considered, as the 
addition of two entries is not defined. However, the addition of 
a negative and a non-negative element, as well as the addition 
of two zero elements is a straightforward task. The result 
of the addition is the non-negative element and the element 
— 1, respectively. Using this approach, redundant checks can 
be created by the linear combination of two existing checks, 
which do not share a positive element in any column. Lifting a 
redundant check leads to a set of z checks for the binary matrix 
H, which are subsequently used to create sets of non-equal, 
binary parity check matrices. As an example, we state that the 
linear combination of rows 11 and 12 in iJb leads to z binary 
redundant checks of weight 10, since the non-negative entries 
in rows 11 and 12 have disjoint column positions, except for 
the last column, which contains zero entries. 

Depending on the length of the code, we replace 10 to 16 
parity checks in the existing parity-check matrix to generate a 
new representation. At this step, we ensure that the resulting 
parity-check matrix has full rank. 

Let us now compare this result to the approach from Sec- 
tion IIl-A by means of the WiMAX code of length n = 576. 
The local girth of its parity-check matrix varies between c = 6 
and c = 8. Using Equation (1) and c = 6, it can be deducted 



that additional parity-check representations have a weight of 
at most 12 to 15, depending on the actual parity checks used 
to create the linear combinations. It was verified by computer 
simulations that this bound is met by the realizations. 

The authors are aware of the fact that this novel method is 
still a suboptimal approach and therefore assess it in a more 
general manner. The methods provided in [21] allow for an 
efficient search of low- weight codewords. Using these methods 
to the dual of the IEEE 802. 16e rate-l/2-code of length 576 
did not return any codewords which are not already present in 
the rows of the original parity-check matrix of weight below 
10. This allows us to conclude that the proposed method is 
well suited for the considered class of codes. 

IV. Results and Comparison 

We present simulation results for codes from the WiMAX 
standard of different length. In this context, we apply standard 
BP decoding as well as the (L)-MBBP approach to show 
the performance improvements obtained with this method. We 
allow all BP decoding units to perform at most 200 iterations. 
This is a proper choice for which a further increase does not 
improve the standard BP decoding performance significantly. 
We also limit the number of different parity-check matrices in 
an MBBP setup to 15 and allow leaking with an initial setting 
of PC — 0.9, what results to a maximum number of 30 de- 
coders in parallel. The current development of multiprocessor 
techniques [22] allows us to state that this setting can easily 
be parallelized with upcoming microcontroller techniques. 
Furthermore we set the parameter = 300, as this setting 
leads to desirable results in our computer simulations. 

Figure 2 shows performance results for the WiMAX codes 
of length n = 576 and n = 960. In order to emphasize that the 
bigger part of the decoding gain is already obtained by a low 
number of decoder representations, we show different MBBP 
settings. To be precise, we allow i = 7, i = 15, and / = 30 
representations to run in parallel. In Figure 2 we observe 
that the most prominent part of the decoding gain is already 
achieved with 7 decoders in parallel and another small gain is 
achieved for I = 15. The setup using L-MBBP and utilizing 30 
decoders in total compares favorably but the difference is small 
in relation to the number of decoders additionally required. Us- 
ing all decoding units, the proposed multi-decoding approach 
improves the performance of WiMAX codes for about 0.15 
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Fig. 2. BER and FER performance comparison of IEEE 802.16e codes with 
BP and the L-MBBP approach. 

dB. The random coding bound (Gallager bound) [23] marks 
desirable performance values and is shown for comparison 
reasons. In order to provide performance results on the BER, 
we estimate the minimum distance d for random codes of 
given length and rate by means of the Gilbert- Varshamov- 
bound [24] and assume for the random coding bound that d 
errors happen in an erroneously decoded frame. Details on this 
approach can be found in [16]. 

In a next step, we assess our results in a more general setting 
and compare the codes defined in the WiMAX standard to 
PEG-optimized codes of equal rate and length 500 < n < 
1000. We also compare these results to the Gallager bound 
and the sphere packing bound. Detailed information on the 
latter bound can be found in [25]. For the PEG codes, we use 
the optimized degree distribution 



0.0572634080 • + 0.0362602194 • + 

0.0049622081 • .t^ + 0.0292344776 • + 
0.0650312477 • a:" + 0.0072858305 • (4) 

from [26], which has a gap to capacity of about 0.2 dB and 
leads to desirable results for the code lengths of interest [16]. 
Within the error region of interest, the created ensembles show 
strictly concentrated behavior, what allows us to study the 
subsequent results independent of the random seed used for 
the construction algorithm. 

Figure 3 shows the signal-to-noise ratio 10 • logiQ{Eij/No), 
which is required to obtain the reliability criterion BER = 
10~^ and FER = 10^"^, respectively. Plotted are results for 
WiMAX codes and PEG-optimized codes for both BP and L- 
MBBP decoding as well as the Gallager bound. In order to 
keep an appropriate presentation for the numerical results, but 
still provide the reader with an idea of the position of the 
sphere packing bound (SPB), we choose to plot the left-most 
part of it and state that its shape is shown to be similar to the 
shape of the Gallager bound in [16]. 

Let us first consider the results for the WiMAX codes. In 
our simulations, the codes showed slightly different error-floor 
behavior. This holds in particular for the code of length n = 
864. It is to observe that a gain of about 0.15 dB is achieved for 
all code lengths considered. From the plot for FER = 10~^ 
and the code of length n = 960 we observe that the gap to 
the Gallager bound reads about 0.7 dB, which can be lowered 
by 0.14 dB (or 20 %) with the L-MBBP approach. 

Similar results are presented for the PEG-optimized LDPC 
codes, where we also restrict the maximum number of de- 
coders in parallel to 30. The actual number is however lower 
due to lack of weU-performing presentations. The PEG codes 
show the desired performance results at about 0.15 dB lower 
signal-to-noise ratios. Again, the L-MBBP approach mitigates 
the gap to the random coding bound by about 20 %. 

It is worth mentioning that the codes defined in the WiMAX 
standard have a significantly lower density compared to the 
considered PEG codes. This aUows for faster decoding with 
the BP algorithm. If one considers not only the length but also 
the decoding speed as a system parameter, the standardized 
codes are comparable to the PEG-optimized codes discussed 
in this work. Detailed results on this comparison can be found 
in [14]. 

V. Conclusions 

The contribution of this paper is two-fold. First, we adapted 
the scheme of MBBP decoding to codes from the WiMAX 
standard what allowed us to improve the decoding perfor- 
mance for about 0.15 dB. As a second contribution, we 
compared the performance of the WiMAX codes with the 
performance of PEG codes. Both for BP decoding and MBBP 
decoding, the PEG codes obtained a measurable performance 
improvement compared to the codes in the WiMAX standard. 
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